On the Finiteness Problem for Automaton (Semi)groups 
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Abstract 



CN ! This paper addresses a decision problem highlighted by Grigorchuk, Nekrashevich, and Sushchan- 

skii, namely the finiteness problem for automaton (semi)groups. For semigroups, we give an 
effective sufficient but not necessary condition for finiteness and, for groups, an effective nec- 
essary but not sufficient condition. The efficiency of the new criteria is demonstrated by 
testing all Mealy automata with small stateset and alphabet. Finally, for groups, we provide 



^ I a necessary and sufficient condition that does not directly lead to a decision procedure. 

1 Introduction 

> 

^n ' Automaton (semi) groups — short for semigroups generated by Mealy automata or groups gener- 

ated by invertible Mealy automata — were formally introduced a half century ago (for details, 
see [9] and references therein). Two decades later, important results have started revealing their full 
potential. In particular, contributing to the Burnside problem, [I] [1^] construct Mealy automata 
generating particularly simple infinite torsion groups, and, answering to the Milnor problem, [71117) 
produce Mealy automata generating the first examples of (semi)groups with intermediate growth. 

Since these pioneering works, a substantial theory continues to develop using various methods, 
ranging from finite automata theory to geometric group theory, and various viewpoints from 
self-similarity to natural actions on regular rooted trees (see |51 [SJ [HI [HI [ISl [IHl [M] for groups 
and [3 [m [THl [m [m [23 for semigroups) and never ceases to show that automaton (semi)groups 
possess multiple interesting and sometimes unusual features. 

The classical decision problems have been investigated for automaton groups and semigroups: 
the word problem is solvable [T2j [18] while the conjugacy problem has recently been proved to be 
unsolvable [29]. Here we address the finiteness problem, that is, the question of the existence of an 
algorithm that takes as input a Mealy automaton and decides if the generated (semi)group is finite 
(see [m Problem 7.2.1(b)]). Since the word problem is solvable, then a semidecision procedure 
for the finiteness problem simply consists of enumerating all the elements. 

Three results related to the finiteness problem have to be mentioned here. First, the finiteness 
problem is solved for the special class of semigroups generated by (dual) Cayley machines (see [HI 
[m [211 [17]) by using semigroup theory and especially the Green's relations machinery. Second, 
the class of those automata which always generate finite (semi)groups independently of their 
output function has been completely characterized (see [11[3J[1S]). Third, the class of so-called 
"bounded" (invertible) automata where all the states have growth degree at most has been 
thoroughly studied and the solution to the order problem (see [ini US]) yields an infiniteness 
criterion. Observe that these three classes correspond to very special structures for the concerned 
Mealy automata. 
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Two GAP packages are dedicated to automaton (semi) groups: FR by Bartholdi and automgrp 
by Muntyan and Savchuk ^[T31I13]. Both include specific (in)finiteness tests. Besides the three 
results above-mentioned, all that was known up to now about the finiteness question for automaton 
groups happened to be somehow summarized in the documentation for FR: 

The order of [an automaton] group is computed as follows: if all [the states have growth 
degree at most 0], then enumeration will succeed in computing the order. If the action of the 
group is primitive, and it comes from a bireversible automaton, then the Thompson- Wielandt 
theorem is tested against [. . .] see [TTl Prop. 2.1.1]. Then, FR attempts to find whether the 
group is level-transitive (in which case it would be infinite). Finally, it attempts to enumerate 
the group's elements, testing at the same time whether these elements have infinite order. 

Needless to say, none except the first few steps are guaranteed to succeed. 

In this paper, we give several new criteria for testing (in) finiteness, that could easily be added 
to the FR and automgrp packages. The original ingredients in these packages mainly come 
from geometric group theory. Our new notions and tools — like helix graphs and minimization- 
dualization — are automata-theoretic in nature and most often work in the general setting of 
semigroups. The common idea is to put a special emphasis on the dual automaton^ obtained 
by exchanging the roles of stateset and alphabet. The stepping stone is Proposition 12.71 stating 
that any Mealy automaton generates a finite semigroup if and only if so does its dual. The 
general strategies vary by analyzing a Mealy automaton and its dual either alternatively — see 
the minimization-dualization reduction in Section [3] — or both together as a whole — see the helix 
graph construction in Section |4l 

In Section [3l we give an effective sufficient but not necessary condition for finiteness using 
minimization-dualization. Focusing on those invertible automata with invertible dual, and using 
helix graphs, Section|3]provides an effective necessary but not sufficient condition for finiteness, and 
also a non-effective necessary and sufficient condition. The decidability of the finiteness problem 
remains open. 

Gathering the new criteria with the previously known ones allows to decide the (semi)group 
(in)finiteness for substantially more Mealy automata. In Table [TJ we report on the results of the 
experimentation carried out on: (i) all 3-letter 2-state Mealy automata; {ii) all 3-letter 3-state 
invertible or reversible Mealy automata. The first three columns are the number of automata 
treated successfully respectively by previously known criteria, our new criteria, and the union of 
both. The last column is the total number of Mealy automata. The automata are counted up to 
isomorphism. 

Table 1: Some results of the experimentations to decide (in)finiteness with old and new criteria. 





previous criteria 


new criteria 


previous+new 


total 


general (3,2) 


398 


1130 


1214 


4003 


inv. or rev. (3,3) 


78 721 


100 924 


172 737 


236 558 



More detailed experimental results are given in Section [5] and a gallery of meaningful examples is 
given in Table [5] 

2 Preliminaries 

Let S" be a finite and non-empty set. We denote by Xs the set of functions from S to S, and we 
denote by 65 the set of bijcctions from S to S. 

2.1 Mealy automaton 

If one forgets about initial and final states, a (finite, deterministic and complete) automaton A is 
a triple [A, 1^,6 — {Si : A ^ A)igi;), where the set of states A and the alphabet T, are non-empty 



2 



finite sets, and where the Si^s are functions. In a condensed way, the automaton is identified with 
S, that is an element of T^. 

A Mealy automaton is a quadruple 

{A, E, ^ = {S, : A P ^ {pa^ : ^ S)xeA) , 

such that both (A, E,(5) and p) are automata. Another standard terminology for Mealy 

automaton would be: letter-to-letter transducer with the same input and output alphabets. A 
Mealy automaton is identified with an element of x 1^. 

Graphically, a Mealy automaton is represented by a labelled directed graph with: 



nodes : A, 



arcs (transitions) : x — ^ y if Si{x) — y and Pxii) = j 



u| V 

The notation x — > y with u — ui ■ ■ ■ i 

Ui\vi U2\V2 Un\Vn . „ 

X — > xi — > X2 ■ ■ ■ Xn-1 — > y m A. 



V = wi ■ • • w„ is a shorthand for the existence of a path 



Two examples of Mealy automata are given in Fig. [TJ 

1|0 0|1 1|0 





1 1 1 1 

Figure 1: Two Mealy automata. 

In a Mealy automaton {A, S, S, p), the sets A and S play dual roles. So we may consider the 
dual (Mealy) automaton defined by d{A) = {T,, A, p,S). Alternatively, we can define the dual 
Mealy automaton via the set of its transitions: 

x^y eA ^ i^j e ^(A) . (1) 

In what follows, it is often pertinent to consider a Mealy automaton and its dual together, that is 
to work with the pair {A,d{A)}. A pair of dual Mealy automata is represented in Fig. [2] 



1|0 1|1 b\a b\b 

o|i a\b 

0|0 a.\a 



Figure 2: A pair of dual Mealy automata. 

Consider a Mealy automaton A e x Let A^^ — {x^^,x G A} be a disjoint copy of A. 
The inverse (Mealy) automaton A^^ e '^a-i ^ ®s defined by the set of its transitions: 

x^y eA ^ x-^^y-^eA-^ (2) 

Let us call respectively dualization (denoted 0) and inversion (denoted i) the two transfor- 
mations on transitions defined in ([T]) and ([2|). Starting with a transition and alternating the 
dualization and inversion transformations, we obtain eight transitions. (In the process, we also 
define S"^ = {x~^,x G S}, a disjoint copy of E; and we set (A~^)~^ = A and (E"^)"^ = E.) 

Now consider a Mealy automaton A identified with its set of transitions, and apply the same 
transformations to A. We obtain eight sets of transitions that we denote by: 

A, d{A), i{A), di{A), id{A), did{A), m{A), didi{A) = idid{A) . 

If ^ £ X then i(^) = A~^. Apart from 0(^1) which is always a Mealy automaton, the 
other six sets may or may not define a Mealy automaton depending on A. 
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By tracking the content of the sets of transitions, we observe the foUowing: 

[mi{A) e X '^s] =^ 

A,d{A),i{A),-Oi{A),i:i{A),m{A),m{A),mi{A) e x 6^ • 

Let us introduce some additional terminology. 

Definition 2.1 A Mealy automaton is invertible if it belongs to x and reversible if it 
belongs to 6^ ^ "^s- ^ Mealy automaton is an IR-automaton if it is both invertible and re- 
versible, that is, if it belongs to 6^ x // is a Mealy automaton, we say that A (resp. 
d{A), . . . , OiOi(yi) ) is bireversible. 

The terms "invertible, reversible, and bireversible" are standard since [20]. The acronym IR- 
automaton is introduced for convenience. IR-automata are of particular interest and the core of 
the paper is devoted to them. In Fig. [U the right Mealy automaton is an IR-automaton, but not 
the left one. 

Mealy automaton of order (n, k). Consider a Mealy automaton A — {A, S, S, p) in x 
and n, fc > 0. The quadruple 

yi„,fc = ( A", E^ (5x : A" ^ , (Pu : ^ S')ugA" ) 

is a Mealy automaton in x that we call the Mealy automaton of order (n, k) associated 
with A. Observe that Ai^i = A. 

In Fig. [31 we show the Mealy automaton of order (2, 1) associated with the Mealy automaton 

of Fig. m 




Figure 3: Mealy automaton of order (2, 1). 



2.2 Helix graph 

We have already seen two equivalent ways of presenting a Mealy automaton: {i) as a quadruple 
{A, E, 5, p), {ii) as a labelled directed graph (see Fig.[5|). We propose here a third and original one 
which turns out to be very convenient. 

The helix graph M of a Mealy automaton A — {A,Y,,6,p) is the directed graph with nodes 
AxT, and arcs {x, i) — > (^5i{x), Px{i)) for all (x, i). The helix graph "Kn.k of order (n, k) associated 
with A is the helix graph of An.k- In Fig. [31 we have represented the helix graph of the Mealy 
automaton of Fig. [2] 




Figure 4: Helix graph. 



Bireversible automata have a nice characterization using the helix graph. 
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Lemma 2.2 Consider an IR-automaton A with helix graph "K. We have: 

[ A bireversible ] [ J{ union of cycles ] . 

Proof. Define the directed graph J-C as follows: 

• nodes: A^^ x 

• arcs: {x^^,i^^) — !■ {y~^,j^^) if — > {x,i) is an arc of 3-C. 

If d\d\{A) is a Mealy automaton, then 3-C is its helix graph. 

Conversely, assume that A is an IR-automaton and that is a union of cycles. Consider a 
node of IH: it has a unique predecessor in ^Ki_i. □ 

2.3 Automaton (semi)group 

Let A — {A,I],S,p) be a Mealy automaton. We view A as an automaton with an input and an 
output tape, thus defining mappings from input words over E to output words over E. Formally, 
for X e A, the map : E* — E*, extending p^, : E — >■ E, is defined by: 

Pxiu) = V if 3y, X . 

By convention, the image of the empty word is itself. The mapping is length-preserving and 
prefix-preserving (the prefix of the image is the image of the prefix). It satisfies 

Vu e E, Vv e E*, px{uv) = px{u)ps^(^){-v) . (3) 

We can also use ([3]) to define px ^* ^ E* inductively starting from : 5] — !> E. We say 
that pr^ is the production function associated with [A^x). For u ~ ui • • • w„ e A", n > 0, set 
Pu : E* ^ E*, pu = p„„ o • • • o . 

Definition 2.3 Consider A G x T^. The semigroup of mappings from E* to E* generated by 
Px,x e A, is called the semigroup of ^1 and is denoted by {A)+. Assume that A G x 6^. The 
group of mappings from E* to E* generated as a group by px, x A, is called the group of A and 
is denoted by (A). 

The above definition makes sense. Indeed if yi G 1^ x 6^, then the production mapping px 
associated with {A,x) is a bijection from E* to E*. The inverse bijection p~^ : E* ^> E* is the 
production mapping Px~^ associated with {A^^ , x^^), where A~^ is the inverse Mealy automaton 
defined in Therefore, we have 

{A)+ = {pu, u G A*}, (A) = {pu, u G (A U A-')*} . 

Lemma 2.4 Let A be an IR-automaton. Then we have (A) = (A^^) = (^1 U A^^) = (^1 U A^^) + , 
where A U A~^ is the Mealy automaton whose set of transitions is the union of the ones of A and 
A~^ . Furthermore, if either {A) or {A)+ is finite, then we have (A) = {A)+. 

Proof. The first statement follows directly from the definitions. Suppose that {A)+ is finite 
and let x be one of its elements. Since the semigroup {A)+ is finite, there exist k and n such 
that x""'"'^ = x^ . So we have x" = 1 in the group (^1). Hence the inverse of x is which 
belongs to the semigroup (.A} + . So we have {A) — (^} + . Assume now that (^1) is finite. Since 
the semigroup {A)+ naturally embeds into the group (71), it is also finite. □ 

Definition 2.5 A semigroup M is called an automaton semigroup if there exists a Mealy automa- 
ton A such that M ~ (■A)+. A group G is called an automaton group if there exists an invertible 
Mealy automaton A such that G = (A). In both cases, we say that A generates the (semi)group. 
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Denote dually hy Si : A* ^ A* ,i ^ ^, the production mappings associated with the dual Mealy 
automaton 0(^1). For -v — vi ■ ■ ■ Vn G S", n > 0, set ■ A* ^ A* , = Sv„ o ■ ■ ■ o S^^. 
A pair of Mealy automata {^,0(71)} generates a pair of (semi)groups. 
Examples of automata (semi)groups are given in Table [2] 

The two following propositions complement each other. Proposition 12.71 is proved by Nekra- 
shevych for a pair of dual bireversible Mealy automata [Ml Lem.1.10.6]. For the sake of complete- 
ness, we provide a similar proof in the general case. 

Proposition 2.6 Let G and H he two finite semigroups. There exists a Mealy automaton A such 
that {A)+ = G and (£)(yi))_|_ = H . Let G and H be two finite groups. There exists an IR-automaton 
A such that (A) = G and {d{A)) ^ H. 

Proof. We carry out the proof for groups. The argument is similar for semigroups. 

Any finite group is a subgroup of a permutation group. Let Si and A2 be two finite sets such 
that G is a subgroup of ©s^ and H is a subgroup of • Let Ai C 6si be a set of generators 
of G, let T,2 C &A2 be a set of generators of H. 

Set A — Ai X A2 and E = Si x £2- Consider the Mealy automaton A with states A, alphabet 
S, and transitions 

(a, 6) > {a,j{b)) . 

Denote the corresponding mappings by S and p. Clearly, for (a, b) G Ai x A2 and (a, b') e 
Ai X A2, we have P(a,b) = P(a.b') sjnd we denote this mapping by : E* — !• E*. We have, 
Va e Ai,y{ii,ji) ■ ■ ■ {in, in) e E*, 

Pa((«l,Jl) ■ • ■ (in,in)) =(a(jl),jl) {a{i2),j2) ■■■ jn)- 

So the group generated by {pa : E* — )> E*)^^^^ is isomorphic to the group generated by (a : Ei — >• 
Ei)aeAi. That is (^l) = G. Similarly, (0(^1)} =H. □ 

Proposition 2.7 Let A he a Mealy automaton. The semigroup {A)+ is finite if and only if the 
semigroup {d{A))+ is finite. 

Proposition 12 . 71 extends to groups using Lemma [2.41 

Proof. Set A = {A,T,,d,p) and assume that {d{A))+ = {6^ : A* ^ A*, u G E*} is finite. 
Consider the Cayley graph S of (0(^1))+ with respect to the set of generators E, see the left of the 
figure just below. Now fix w £ A* and recall that 

Pw(wiU2 • •■■««) Pw(wi)P5„j(w)(w2)P5„^„2(w)("3) " ' ' P5„ ^ ..^ . . .„„_^ (w) (Wn) , 

for all U1U2 ■ • ■ Un £ E*. This shows that pw can also be described as the output map of a 
letter-to-letter transducer built upon 9, see the right of the figure. 

Now observe that there is only a finite number of possible different transducers built on S, which 
is equal to the number of different mappings from to Is. We conclude that ^{A)+ < 

(#(S(.A)> + ) l_l 

The growth of a Mealy automaton is defined as the growth of the number of different elements 
Pu, u e A", as a function of n, see [7l[T5]. Automata generating finite (semi)groups are those of 
finite growth. Looking at the 2-letter 2-state automata, it appears that it is the only growth class 
within the known growth classes (finite, polynomial, intermediate and exponential) to be stable 
by dualization. 

Let A be an IR-automaton. Recall that (A) — {AU A^^). In words, considering the states 
and their inverses does not modify the generated group. We can also consider the letters and their 
inverses. Set ^1 = yi' U (^1')"^ where A' = 0(5(^1) U The Mealy automaton A is the 

extension of A with stateset A U A~^ and alphabet E U E~^. 

Next result is a corollary of Proposition 12. 71 and Lemma [2.41 
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Table 2: Examples of automata (semi)groups. 



infinite world 



generated (semi)group 



the semigroup S12 
(the very smallest Mealy 
automaton with interme- 
diate growth, see [7]) 



diagram 



1 
10 



0|1 



111 



helix graph 




finite world 



helix graph 




diagram 




2 2 



gen. (semi)group 



an order f 3597 
semigroup 



the Grigorchuk group 
see [18] 




, nil oif* 






the group Z2 x 



the Basilica group 
see flSl 




@ ^oO) ^ 




0|1 
110 



0|0 

111 



the Klein 4- 
group V — 
I2 X I2 



the lamplighter group 

L = z ; Z2 

see [18] 




the rank 3 free group 
(Alesin automaton) 

see fT1l28l 






-oi^- 

110 






1 


1 


2 


2 





a Yr 



3|2 



1 

1 

2 2 

3|2 

3 



an order 36 
group 



the free product 
Tf = Z2 * Z2 * Z2 
(BabyAlesin automaton) 






0|1 
2|3 




the group G^g^ 



Corollary 2.8 Let A be an IR-automaton. The groups {A) and {A) are either both finite or both 
infinite. 

The above groups are not necessary equal. Consider for instance the automaton A generating 
G^ig^ in Tabled we have \ {A)\^ 16 and \{A)\^ 64. 

3 Reduction of Mealy automata and finiteness 

Here we define the mX) -reduction of Mealy automata which provides a sufhcient condition of finite- 
ness. The condition is not necessary and two counterexamples arc provided. 

3.1 Minimization of a Mealy automaton 

Definition 3.1 Let A — (A, I],(5, p) be a Mealy automaton. An equivalence = on A is a congru- 
ence for A if 

[Wx, y e A, x = y] =^ [Vz G E, px{i) = py{i) and Si{x) = Si{y)] . 
The Nerode equivalence on A is the coarsest congruence for A. 

The Nerode equivalence is the limit of the sequence (=fc) of increasingly finer equivalences defined 
recursively by: 

yx,y€A, x=oy<iF=^yie^,Px{i)^Py{i), 

yk ^ 0,x =k+i y X =k y and Vi £ S, 6t{x) =k 5i{y). 

Since the set A is finite, this sequence is ultimately constant; moreover if two consecutive equiva- 
lences are equal, the sequence remains constant from this point. The limit is therefore computable. 
For every x in A, we denote by [x\ the class of x w.r.t. the Nerode equivalence. 

Definition 3.2 Let A = {A, E, 5, p) he a Mealy automaton and let = be the Nerode equivalence on 
A. The minimization of A is the Mealy automaton A /= = {A/=,'Ei,S, p), where for every {x,i) in 
AxY., Si{[x]) = [Si{x)] and p[x]{i) = Pxii)- 

This definition is consistent with the minimization of "deterministic finite automata" , where in- 
stead of considering the production functions {px)x, the computation of the congruence is initiated 
by the separation between terminal and non-terminal states. 

Lemma 3.3 Let A — p) be a Mealy automaton, and let A/= be its minimization. The 

function on E* generated by x in A is equal to the function generated by [x] in A/ =. Therefore, 
the Mealy automata A and A/ = generate the same semigroup. 

Proof. Let {in)nehi be a sequence of words of E* such that for all integer n, the length of i„ 
is n and i„ is a prefix of i„+i: in+i = ini„+i, where in+i G E. We prove by induction on n that 
for every x of A, we have px = P[x] on E". It is obviously true for n — 0. If n > 0: 

Pxi^n) =Px{Ui~l)PSi^_^{x){in) 
=Plx] (in-l)P[<5i,,_ J (a;)] 

^P[x]{hi-l)Ps.^_^(^[x])('^-'i) = P[x]{^n)- 

□ 
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3.2 The tnD-reduction of Mealy automata 

Observe that the minimization of a Mealy automaton with a minimal dual can make the dual 
automaton non-minimal. 

Definition 3.4 A pair of dual Mealy automata is reduced if both Mealy automata are minimal. 
Let m be the operation of minimization; recall that X) is the operation of dualization. The tnO- 
reduction of a Mealy automaton consists in minimizing the automaton or its dual until the resulting 
pair of dual Mealy automata is reduced. 

If both a Mealy automaton and its dual automaton are non-minimal, the procedure of xriO- 
reduction seems to be dependent on the first automaton chosen for the minimization. The reduc- 
tion is actually confluent: 

Proposition 3.5 // (.A, !B) is a pair of dual Mealy automata, the reduced pair obtained by mini- 
mizing A first is the same as the one obtained by minimizing 23 first. 

Proof. If {A, 23) is reduced, both Mealy automata are minimal, and the proposition trivially 
holds. 

Otherwise, the proof is by induction on the total number of states in A and 23. Let (yii,23i) 
be the pair obtained by minimizing A and let {A2, 232) be the pair obtained by minimizing 23. Let 
us setA = iA,E,6,p), Ai = (^i, S, J^^^ pW), and .^2 = {A,E'2,S^'^\ p^'^^). Let =1 and =2 be the 
congruences on A and 23 such that Ai = A/=i and E2 = S/=2. We show that =1 is a congruence 
on A2. Let X and y he in A such that x =1 y. Then, for every i in S, Px{i) — Py{i) and therefore, 
p^x \[i]) = [Pxii)] = [Pvii)] = P^y \[i]); besides, 5^f^{x) = di{x) =1 di{y) = s'^^y). Hence, =1 is a 
congruence on A2 and, likewise, =2 is a congruence on 23i. We consider now the Mealy automaton 
A' = (^1, E2, S',p') which is the quotient of ^2 with respect to =1, and 3' = (E2, 5") which 

is the quotient of Si w.r.t. =2. For every a; in ^ and every i in S, it holds: 

^"[i](N) = ^r^M) = Mx)] = [d^^ix)] = 6[^{[x]) . 
Thus, 6" = S' and Ukewise />" = p'. 

A "B 

=1: m{A)^ ' ^2: m(S) 
AijTii ^2,232 

mCBi)/ =^ /^i \m(yi2) 
A', S' 

Asf'Bs Ai,'£>i 

Consider now A2 = {A,ll2, p^'^^) and A' = {Ai,T,2,S' , p'). Clearly, applying the coarsest 

congruences respectively on A in ^12 and Ai in A' will result in the same minimized Mealy 
automaton ./I4. The minimized Mealy automaton 233 is defined similarly starting from either 23 1 
or S'. Let 234 be the dual of A^, and let A^ be the dual of S3. By construction, the pair (^3, S3) 
(resp. (yi4,S4)) is the one obtained from (^1, S) by minimizing first A (resp. S) then S (resp. 
A). But the pair (A^^'B^) (resp. {Ai^Tii)) is also the one obtained by applying one minimization 
step starting from (yi',S'). Observe that the pair [A' ,'&') has a number of states strictly smaller 
than the one of {A^H). By induction hypothesis, starting from (yi',S'), the mt)-reduction does 
not depend on the first minimization step, which proves the result. □ 
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3.3 A sufficient condition for finiteness 



A trivial Mealy automaton is a Mealy automaton with one state over a one-letter alphabet. It 
clearly generates the trivial group. 

Theorem 3.6 If the ml} -reduction of a Mealy automaton (resp. an invertible Mealy automaton) 
leads to a trivial Mealy automaton, then the automaton generates a finite semigroup (resp. a finite 
group). 

Proof. Let (^,23) be a pair of dual Mealy automata and assume that there exists a sequence 
of dual Mealy automata {{Ak,'Bk))ke[o.m] such that (yio,23o) = (-A, 23), {A,n,'Bm) is trivial and, 
for every k £ either Ak is the minimization of Ak-i or 23^ is the minimization of 'Bk-i. 

By Proposition 12. 7[ for every k, if Ak or 23^ generates a finite semigroup, both automata 
do. Obviously, Am and 23m both generate the trivial group. We prove that if Ak generates a 
finite semigroup, so does Ak-i- If Ak is the minimization of Ak-i, by Lemma 13.31 they both 
generate the same semigroup. Otherwise, 23^ is the minimization of Hk-i- Then 23^ generates a 
finite semigroup fProp. I^TTl) . so does Tik-i fLem. 133)) . and thus Ak-i (Prop. [HT]). Therefore A 
generates a finite semigroup. □ 

Let A be the following automaton: 




3 
2 1 



Let us compute the mO-reduced automaton of A. 
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a\b 



1|0 
312 



0|1 
213 





1|0 
312 



b\a 



a I a 
b\b 



0|3 
211 



a 


a 


b 


b 



b\a 



13102^ 02113 





13102 



ala 
b\b 



13 1 02 
02113 



02113 



q 

ab) 



ab I ab 



ab I ab 



0123 1 0123^ 
CaS) 



ab I ab 




The group generated by A is finite and can be shown to be isomorphic to G^q, that is, the 
group of order 16 with presentation 

{ a,b : a'^ = = abab = 1, ab^ = ba^ ). 
Now consider the family (M^ of bireversible p-letter g-state Mealy automata: 

i I i 




One can check that (5mc)m)(M* ^) is trivial for any p and q. Hence by Theorem I3.6| the groups 
(M^ are all finite. In fact and independently, the group (M^ ^) can be identified with 6^. For 
comparison, the packages FR and automgrp both fail to decide finiteness of (Mj,^^) (except for 
very small values of p, q). 

3.4 This sufficient condition is not necessary 

The following Mealy automaton is mO-reduced, but it generates a finite semigroup of order 6: it 
provides a counterexample to the converse of Theorem [ 
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There also exist counterexamples among bireversible Mealy automata. Consider the order 8 dihe- 
dral group viewed as generated by a reflection a and by a product [i — pa with a rotation: 

Z?4 = { a, ^ : (7^ = = (cr/i)* = 1 ). 

It is generated by the bireversible Mealy automaton of Fig. [S] This ad-hoc automaton is its own 
dual and is mO-reduced. 




1|1 



Figure 5: An mD-reduced non-trivial IR-automaton whose group is finite. 



4 Helix graphs and finiteness 

In this section, we concentrate on IR-automata and show the pertinence of helix graphs for the 
finiteness problem. 

4.1 A necessary condition for finiteness 

To prove the results in this section, it is convenient to use a graphical representation in which 
A and S play symmetrical roles. Consider (x, i) G A x E with di{x) = y and Pxii) — j- The 

corresponding transition x y is represented by the cross-transition: 



The automaton A is identified with the set of its cross-transitions (of cardinality \A\ x 

A path in A {resp. in d{A)) is represented by an horizontal (resp. vertical) cross-diagram ob- 
tained by concatenating the crosses. We may also consider rectangular cross-diagrams of dimension 
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mxn, on which one can read the production functions oiAm.n and 0(^1 
k in 



For instance the cross- 



Xl 



diagram: 



2/1 



corresponds in Am.n to 

Pxi-x^{il ■■■in) = jl ■■■jn, 
^tl-iA^l ■ ■■Xrn) = 2/1 • • - ■ 



31 



Replacing every cross by a square, we get the "square-diagrams" of fl4'. 

Proposition 4.1 Let A be an IR-automaton. If the helix graph of order (1, 1) of A is a union of 
cycles, so are all the helix graphs (of any order) of A. 

Proof. Observe that a helix graph is a union of cycles if and only if any node has a predecessor. 
By assumption, IK is a union of cycles, therefore, any (x, tt) € AxU has a predecessor. Now consider 
(x, u) e A™ X E" with X. — XI--- Xrn and u = mi • • • m„. Let (im, Wn) be the predecessor of (xm, Wn) 
in "K. Start with the cross of (xm,{t„) and (xm,u„) (left of and expand it step-by-step using 
the existence of predecessors in M (right of ^ for the first few steps). 



Xni — l 



(4) 



Un~l 



In the end we get a cross-diagram of dimension m x n. The words on the west and north of the 
cross-diagram form a predecessor for (x, u). □ 

Theorem 4.2 Let A be an IR-automaton. If (A) is finite, then the helix graphs of A are unions 
of cycles. 

Proof. By Proposition 14. 11 it is sufficient to prove the result for order (1,1). Consider x ^ A 
and i e S. According to Proposition 12.71 {(){A)) is finite. Therefore, there exist m,n > such 



that 



id(yi) and ST 



id(o(A))- It implies that x^' 



X™ is a transition in the 



Mealy automaton of order (m, n). The corresponding cross-diagram is represented below: 



i i 

The south-east cross of the diagram provides a predecessor for (x, i). □ 
There exist IR-automata generating infinite groups whose helix graphs are union of cycles. The 
smallest examples are Alesin automata (see Table [2]). 

Next result follows directly from Lemma 12.21 and Theorem 14.21 

Corollary 4.3 Consider an IR-automaton which is not bireversible. Then the group generated by 
the automaton is infinite. 
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4.2 A necessary and sufficient condition for finiteness 

The condition in next theorem is not effective. Hence, it does not directly lead to a decision 
procedure of finiteness. 

Recall the construction and notation defined at the end of section [2731 for an IR- automaton A 
with stateset A and alphabet S, we denote by A the extension with stateset AuA^^ and alphabet 

sus-i. 

Theorem 4.4 Consider an IR-automaton A. The group (A) is finite if and only if there exists 
K such that, for all k,l, the helix graphs 3-C(fc, /) of A are unions of cycles of lengths bounded by 
K. 

Proof. Assume first that {A) is finite: so is (^l) by Corollary 12.81 Theorem 14.21 shows that 
helix graphs of any order are unions of cycles. It remains to prove that the lengths of these cycles 
are uniformly bounded. By Proposition 12. 7) the group {p{A)) is finite as well. Let C be a cycle in 
a helix graph of A and let (u, v) e (A U A~^)* x (E U E~^)* be a node of this cycle. Each node 
of C is of the form (/i(u), ^(v)), where g [resp. h) is an element of {A) {resp. {^{A))). Since the 
nodes are pairwise distinct, the length of the cycle 6 is at most x ^{d{A)). 

Let us prove the converse and assume that the group (^l) is infinite: so is (A) by Corollarv l2.8l 
First we argue that the orders of the elements of (A) are unbounded. Indeed, automata groups are 
residually finite by construction since they act faithfully on rooted locally finite trees. Moreover it 
follows from Zelmanov's solution of the restricted Burnside problem [211 [Ml [20] that any residually 
finite group with bounded torsion is finite. Since (A) is infinite, the orders of its elements are 
unbounded. 

There exists either x G {AuA^^)* such that the order of px is infinite, or a sequence (x„)„gii^ C 
{A U A~^)* such that the sequence (fc„)„ of orders of the elements px„ converges to infinity. We 
carry out the proof in the second case, the first one can be treated similarly. Let us concentrate 
on px„, element of order /c„ of (A). For all 1 < fc < kn, there exists a word Ufe e (S U S^^)* such 
that /o^^(ufe) = Ufe 7^ Ufe. 

Say that a word v G (E U E~^)* is unitary if is the identity of (0(71)). Since {'0(A)) is a 
group, the word can be extended into a unitary word u^Vfe. Set w„ = UiVi • ■ ■ Ufe^_iVfe^^_i. 
By construction, we have: Px„('W'„) = Ui • • • ^ w„. Since UiVi is unitary, we also have: 

Px„(^") = /'x„("l^l)^'x„("2V2---Ufe„_iVfe„_i) 
= Px„("l'^l)"2 • • • 7^ W„ . 

In the same way, we prove that for all /c < /c„, we have p^^(w„) ^ w„. 

In the helix graph of A of order (|x„|, |w„|), consider the cycle containing the node (x„,w„). 
Since w„ is unitary, the successors of (x„,w„) on the cycle are: (x„, px„ (w„)), (x„, ('^n)), 
. . . Therefore the cycle is of length /c„ . Since fc„ converges to infinity, the lengths of the cycles of 
the helix graphs of A are not uniformly bounded. □ 

5 Experimentations 

Here, we show how gathering the new criteria with previously known ones allows to decide the 
(semi)group finiteness for substantially more Mealy automata (at least for those with small alpha- 
bet and stateset — of size up to 3). 



^The table shows that 52 out of 76 (isomorphism classes of) 2- letter 2-state Mealy automata can be treated 
directly using either the old or the new criteria. But actually, the finiteness problem is solved for the 76 cases. 
Indeed, a series of papers dealing specifically with 2-letter 2-state Mealy automata (see [7] and references therein) 
has contributed to the actual state of knowledge; 48 automata generate finite semigroups, 10 generate semigroups 
of linear growth, 17 generate semigroups of exponential growth and 1 generates the semigroup Si^ of intermediate 
growth (see Table [2)1. 
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Table 3: Results of experimentations on 2-letter 2-state Mealy automata. 





invertible 




2-letter 2-state 
Mealy automata 


iJIR 

1 


JI 

14 


JTR 

1 


BIR 

8 


1 


14 


N 

37 


W 

76 




reversible 




previous criteria 


Finitary 

Thompson- Wielandt 
Level-transitive 


1 


5 
4 


1 


3 
5 






1 


9 
5 
6 


Sidki 




1 












1 


Limitary cycles 




4 




6 




8 


6 


6 


Cayley± 
Dual Cayley''' 


1 
1 


1 


1 
1 


1 




1 


2 
3 


6 
6 


union 


1 


11 


1 


8 




8 


8 


37 


new criteria 


mO-trivial 
Cycles 
+Sum 
+Dual 


1 


10 

8 


1 

1 


8 

3 

8 


1 


10 

4 
11 


11 

8 


39 
2 
7 

37 


union 


1 


10 


1 


8 


1 


14 


13 


48 




total union | 1 


14 


1 


8 


1 


14 


13 1 52^ 



5.1 Partition 

For convenience of exposition, we introduce the decomposition of the whole class of Mealy au- 
tomata W (up to isomorphism) into a disjoint union of seven subclasses. By denoting I the class 
of invertible Mealy automata and IR the class of invertible-reversible Mealy automata, the seven 
classes are defined as follows: 

BIR is the class of bireversible Mealy automata, 

JIR (standing for Just IR) is the complementary in IR of BIR, 

iJIR consists of the inverses of automata from JIR, 

OiJlR consists of the duals of automata from iJIR, 

JI (standing for Just I) is the complementary in I of the union IR U iJIR, 
DJI consists of the duals of automata from JI, 

N is the complementary (in W) of the (disjoint) union of the previous six. 

5.2 Previous criteria 
Previously implemented criteria 

The GAP packages FR and automgrp (see [H [131 US]) both overload the functions Order 
and IsFinite by using several criteria mainly coming from geometric group theory. More precisely, 
we have tested all the corresponding functions: IsFinitaryFRMachine, IsLevelTransitive and 
ISFINITE_THOMPSONWIELANDT_FRfrom FR and IsFractal and IsSphericallyTransitive from 
automgrp. While the first two work perfectly, the last three may not stop. From a practi- 
cal point of view, IsSphericallyTransitive allows to discriminate too few automata. Now 
IsLevelTransitive happens to be much slower than IsFractal, so the latter can be advanta- 
geously viewed as a preliminary criterion of the former. The first half of the previous criteria 
part of the following tables expands the performance of these three criteria coming from geometric 
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group theory. For 2-letter 3-state and 3- letter 2-state (resp. 3-letter 3-state) automata, the exe- 
cution time of IsFractal and IsLevelTransitive was limited to 100 000 ms (resp. 200 000 ms). 
The resulting data have to be considered with this arbitrary limitation in mind, together with the 
observation that both functions happen to be significantly sensitive to the representative inside 
an isomorphism class. 

Sidki's criterion 

Based on Sidki's fundamental work, the solution to the order problem [ini [26] for the class of 
so-called bounded automorphisms — that is, with growth degree at most — may provide an 
infiniteness criterion: in any invertible automaton (A, E, (5, p), a bounded state x d A has infinite 
order whenever there exists a label i\j with j 7^ i G S on an edge between x and some state 
belonging to the same strongly connected component. This criterion appears as the second field 
of the previous criteria part of the tables. 

Antonenko's criterion 

An interesting point of view is to investigate those automata {A, 12, 5) compelling all the Mealy 
automata {A,Y,, 6, p) to generate a finite semigroup. A complete characterization of the latter in 
term of limitary cycle given in [2] (see also [25] ) provides a simple effective criterion for finiteness. 
An automaton is with limitary cycle whenever every state x ^ A accessible from some cyclic 
one y (z A (that is, there exists a nontrivial word w G T,* satisfying Su,{y) = y) is without branch 
(that is, Si{x) — 6j{x) holds for any (i,j) G S^). First considered in [3], the branchless condition 
alone is covered by Proposition 12 . 71 and a fortiori by Theorem 13. 61 This criterion appears as third 
field of the previous criteria part of the tables. 

Maltcev's criterion 

Let S* be a finite semigroup. Define the Cayley machine C{S) {resp. the duaP Cayley ma- 
chine C*{S)) to be the Mealy automaton with stateset S, alphabet S, and the following transitions: 
Vx,y e S, 

C{S) : x^^xy, C*{S) : x^^xy. 

According to [21] (see also [22l [12]), for every finite semigroup S, the semigroup generated 
by C{S) {resp. by C*{S)) is finite if and only if S is ^{-trivial {resp. S is J{-trivial and does 
not contain non-trivial right zero subsemigroups). This can be viewed as an effective finiteness 
criterion for those Mealy automata whose isomorphism class intersects the special class of Cayley 
machines {resp. dual Cayley machines) and their possible inverses (which justifies the symbol ± 
in the tables). These two criteria coming from semigroup theory compose the last quarter of 
the previous criteria part of the tables. 

5.3 New criteria 

The first criterion of the new criteria part is the m£)-triviality from Theorem l3.6l Next, the crite- 
rion Cycles corresponds to Corollarv 14.31 which ensures that every automaton from iJIR and JER 
generates an infinite group. The last two criteria are "relative criteria" — which vindicates the 

symbol H allowing in good cases to reduce or transpose the finiteness question to smaller and/or 

simpler automata. The criterion +Sum follows from the easy observation: provided that a Mealy 
automaton decomposes into a sum of (smaller) Mealy automata, it generates an infinite semigroup 
whenever one sum component does so. Finally, the criterion -|-Dual follows from Proposition 12. 71 

^ It should be emphasized that the current term dual for a Cayley machine is not consistent with the widely used 
term dual for a Mealy automaton. 
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As a simple illustration, let us consider the Mealy automaton C below on the left. None of 
the previously known criteria is suitable to detect the infiniteness of (C). Now, the dual 0(6) 
happens to be a sum whose 2-state component is (isomorphic to) the dual J)(2?) of the baby Alesin 
automaton "B (see Table [2]), which turns out to be level-transitive. 




In this way, the isomorphism class of 13 contributes for one in the Level-transitive row only, those 
of 3(23) and 0(6) both contribute for one in the respective -|-Dual rows only and finally that of C 
contributes for one in the +Sum row only. 



Table 4: Results of experimentations on 2-letter 3-state Mealy automata. 





invertible 




2-letter 3-state 
Mealy automata 


iJIR 

14 


JI 

488 


jm, 

14 


BIR 

28 


OiJIE 

14 


, OJI 

175 


N 

3270 


W 

4003 




reversible 




prev. crit. 


Finitary 

Thompson- Wielandt 
Level-transitive 


14 


91 
263 


14 


8 

18 
2 






50 


149 
18 
293 


Sidki 




35 












35 


Limitary cycles 




50 




14 




37 


218 


319 


union 


14 


385 


14 


28 




37 


242 


720 


new criteria 


mO-trivial 
Cycles 
+Sum 
-l-Dual 


14 
2 


194 

28 
132 


14 
2 

14 


26 

14 
21 


2 

14 


55 

59 
104 


386 

99 
118 


661 
28 
206 
403 


union 


14 


202 


14 


27 


14 


159 


427 


857 




total union | 14 


466 


14 


28 


14 


159 


519 1 1214 



6 Conclusion 

In this paper, we have emphasized the interest of the duality of Mealy automata for the finiteness 
problem. Our new approaches enable to treat a much larger number of Mealy automata as 
before, see Section [SJ We also completely settle the case of non-bireversible IR-automata (they 
generate infinite groups). On the downside, the decidability of the finiteness problem remains 
open. However, we believe that the characterization in Theorem 14.41 could lead to a decision 
procedure for bireversible automata. Indeed, experimentations show that the cycle-lengths stay 
almost constant for known finite groups and increase extremely fast for known infinite groups. 
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Table 5: Results of experimentations on 3-letter 2-state Mealy automata. 





invcrtiblo 




3-letter 2-state 
Mealy automata 


iJIR 

14 


JI 

175 


jm, 

14 


BIR 

28 


OiJIE 

14 


488 


N 

3270 


W 

4003 




reversible 




prev. crit. 


Finitary 

Thompson- Wielandt 
Level-transitive 


11 


11 

84 


12 


4 
13 






4 


19 
13 
107 


Sidki 




2 












2 


Limitary cycles 




11 




16 




132 


118 


277 


partial union 


11 


104 


12 


21 




132 


118 


398 


new criteria 


mO-trivial 

Cycles 
+Sum 
+Dual 


14 
2 


55 
69 


14 
14 


26 

8 

28 


14 


194 

66 
395 


386 
313 


661 
28 
74 
835 


partial union 


14 


75 


14 


28 


14 


466 


519 


1130 




total union | 14 


159 


14 


28 


14 


466 


519 1 1214 
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